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ASSISTANT COMMISSIONER FOR September 1 , 2000, 

PATENTS, File 10442-1 OTIS" JA/en 

Washington, D.C. 20231 
USA 

Sir: 

Transmitted herewith for filing is the Patent Application of 
Inventory); Lome TROTTIER al 

For: REAL-TIME VIDEO EDITING ARCHITECTURE 

Your Petitioner prays that Letters Patent may be granted for the invention set forth 
in the enclosed specification including a disclosure, claims and declaration. 

Enclosed are: 
m 4 { 4 ) sheets of informal drawing(s). 

□ An additional copy of this sheet with an Assignment of the invention and 
Form PTO-1595. 

□ Form PTO-1449. 

□ Information Disclosure Statement. 

□ Declaration of Small Entity Status-Small Business Concern, 

□ A Certified Copy of on the basis of which the benefit of priority under 
35U.S.C. 119 is claimed. 
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REAL-TIME VIDEO EDITING ARCHITECTURE 

This application is related to copending US applications filed on the same 
day of the present application and entitled "Flexible video editing architecture with 
software video effect filter components" and "Method and apparatus for real-time 
5 video editing using a graphics processor". 

FIELD OF THE INVENTION 

This invention relates to video editing, Mare precisely, this invention 
describes an architecture that allows real-time video editing. 

10 

BACKGROUND OF THE INVENTION 

Video editing has always been an important issue in video production. Film 
editing was initially done using splicing tools and title blending equipment. However, 
in recent few decades, new techniques appeared. One cornerstone in the evolution 
15 of these techniques was the beginning of the digital era. This new era opened new 
horizons and expanded dramatically the type of editing operations that could be 
performed on video streams. For instance, with this new era, it became possible to 
use the processing power of the computer. 

Today video editing can be performed in a computer using two types of 

20 architecture, 

The first type of architecture involves a dedicated 3D video special effects 
chip or chip set whose task is to perform only video editing operations and hardware 
implemented video effects. While this architecture allows real-time processing, which 
is a need for live broadcasting, this architecture suffers from a lack of upgradebility. 

25 Furthermore, this architecture is usually very expensive and thus not affordable for 
low end users. 

This second type of architecture involves the common graphics chip used in 
computer graphics cards. This architecture allows video editing operations and video 
effects. Furthermore, this architecture allows a software upgrade of the video effects. 
30 However, this architecture cannot handle, in its present configuration, real-time 



SEP, 1,2000 7 : 57PM 



SWABEY OGILVY MTL 514 238 3389 



BO, 9241 P. 5/27 



operations. This is a major drawback that is not acceptable for a professional user 
and is also a great inconvenience for personal users. 

There is thus a need for an architecture that would allow real-time video 
editing without using expensive dedicated hardware, There is also a need for an 
5 architecture that would ailow a software upgrade of the video effects that can be 
performed in real time. 

SUMMARY OF THE INVENTION 

it is an object of the invention to provide a video editing architecture 
10 allowing video editing using various sources of video streams, 

It is another object of the present invention to provide a video editing 
architecture that would make use of the graphics processor in a computer, 

Yet another object of the present invention is to provide a video editing 
architecture that would allow real-time video editing using the graphics chip located in 
15 the computer. 

According to a broad aspect of the present invention, there is provided a video 
editing apparatus for performing video editing in realtime of at least two video 
streams derived from a codec able to retrieve two video sources from a data storage 
device and output two uncompressed video data streams. The apparatus comprises: 
20 a video data storage device; 

a graphics processor having at least two video inputs and a video output; 

a video decoder having a video signal input and an uncompressed digital video 

output; 

a video encoder having an uncompressed video data stream input and a display 
25 signal output; 

a first video bus transferring data between the video output of the graphics processor 
and the video encoder when the apparatus is operating in a realtime video editing 
mode; 



2 



SEP, 1. 2000 7 : 57PM 



SWABEY OGILVY MTL 514 288 3389 



NO, 924 1 ?. 6/27 



a second video bus transferring data between the codec and the at least two video 
inputs of the graphics processor when the apparatus is operating in a realtime video 
editing mode. 

5 The video decoder uses one of the first and the second video buses to transfer data 
to the video encoder in a non-editing playback mode, and the video decoder uses 
one of the first and the second video buses to transfer data to the codec in a video 
capture mode. 

1 0 Preferably, the video decoder transfers data to the codec and to the video encoder 
using the first video bus, 

Preferably, data is transferred from the video output of the graphics processor to the 
codec for compression and storage in the video data storage device. 

15 

Preferably, the graphics processor has an input buffer for storing a sequence of fields 
of the at least two video inputs and an output buffer for storing a sequence of fields of 
the graphics processor video output. 

20 Preferably, the input buffer also stores input graphic image fields. 

Preferably, the graphics processor has an input buffer for storing a sequence of fields 
of the at least two video inputs and an output buffer for storing a sequence of fields of 
the graphics processor video output. 

25 

Preferably, the input buffer also stores input graphic image fields. 

Preferably, the second video bus is a single bus communicating data multiplexed on 
the bus to all of the at least two video input. 

30 
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Preferably, the apparatus further comprises an input for compressed digital video 
input from external device, and a decompression device, one of the at least two video 
inputs comprising decompressed data from the compressed digitai video input. 

5 Preferably, the compressed digitai video input comprises one of an IEEE 1394 
interface and an SDTI interface. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will be better understood by an examination of the following 
10 description, together with the accompanying drawings, in which: 

Fig. 1 presents an overview of the architecture of the invention; this invention 
comprises a graphics chip; 

Fig. 2 shows a block diagram which describes actions to be performed to 
realize a fade effect using the architecture disclosed in the invention; 

15 Fig, 3 shews a block diagram which describes actions to be performed to 

realize a 3D perspective effect using the architecture disclosed in the invention; 

Fig. 4 shows a block diagram which describes actions to be performed to 
realize an organic wipe effect using the architecture disclosed in the invention; 



PREFERRED EMBODIMENT 

Figure 1 is a schematic block diagram of the real-time video editing system 
according to the preferred embodiment which is described herein to teach the 
preferred mode of implementing the present invention with limiting the scope thereof 
25 as defined in the appended claims. While illustrated in the block diagram of Figure 1 
as an assemble of discrete components communicating with each other via distinct 
data signal connections, it will be understood by those skilled in the art that the 
system is provided by a combination of hardware and software components, with 
some components being implemented by a given function or operation of a hardware 
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or software system, and many of the data paths illustrated being implemented by 
data communication within a computer application or operating system. The structure 
illustrated in Figure 1 is thus provided for efficiency of teaching the present preferred 
embodiment. 

5 A key feature of this invention is the use of high performance 3D graphics 

chips to perform a multitude of video special effects and compositing. Within the 
context of the system architecture of this invention, the 2D and 3D command 
functions found in standard high performance graphics chips can be used for video 
processing. These commands can be considered as a set of basic instructions. By 

1 0 combining these commands with the correct parameters and in the correct sequence, 
virtually any visual effects can be achieved in real-time. 

These visual effects include all the standard classes of effects used in video 
production including but not limited to wipes, dissolves, keys, borders, drop shadows, 
trails, sparkles, 2D and 3D DVE's, surface and object morphing, explosions, 

1 5 multilayer compositing, anti-aliasing, spotlights and high lights, etc. 

Of particular importance is the concept of using the video input buffers as 
source textures for 3D texture mapping. This concept allows live video streams to be 
mapped onto any conceivable surfaces or objects. The target surface or object can 
move, change orientation, transition, or morph as a function of time. 

20 The repertoire of 2D and 3D functions used includes but is not limited to the 

following: color and pattern fill, bitblt and stretch bit, plane and byte write mask, block 
write, color keying, video or graphic overlay, look up table based RGBalpha or YUV 
alpha gamma correction, programmable color space conversion, video proc amp 
controls (brightness, contrast, hue, saturation), 3D perspective correct or non 

25 perspective correct texture mapping with bilinear, trilinear, and anisotropic filtering, 
textures with clamp, mirror, fixed border color, non power of 2 textures, mip mapping 
including real-time generation of mip maps from video surfaces, palettized textures, 
environment bump mapping, cubic environment mapping, Gouraud and specular 
lighting, multifunction alpha blending as described but not limited to the description in 

30 Microsoft DX6.7 and 8, fog, stencil, Z and W depth buffering, stencil, edge vector 



5 



SB?, 1. 2000 7 : 59PM SWABBY OGILVY MIL 514 2 B8 5389 HO, 924 1 1 9/2? 



based anti-aliasing, full scene anti-aliasing, fragment buffer based anti-aiiasing, 
rendering to a texture or using the rendering engine to create a new source texture, 
multipass rendering to achieve compositing and other effects, hardware transform 
and lighting, pixei shaders and vertex shaders as described in Microsoft DX8 

5 specification. 

A real-time video stream source 10, such as a camera or a video tape 
recorder, is connected to a video decoder 11 whose uncompressed digital stream 
output signal is fed into a CODEC 12 on a first, dedicated, video bus 40. The CODEC 
12 is capable of video stream compression and decompression in real-time, The 

10 CODEC 12 can also receive compressed video stream from an external device 37 
such as Fire Wire (IEEE 1394) (DV Camcorder) or SDTI. In another embodiment, the 
architecture comprises at least two CODEC 12 in order to divide the processing time. 
This external device 37 is connected to a compressed source interface 38 which is 
connected to the source controller 29. In the preferred embodiment the compressed 

15 source interface converts incoming signals from the compressed source interface 38 
into DV25 format. In another embodiment, the architecture comprises a compressed 
source interface 38 for each available compressed video source 37. The first video 
bus 40 allows the decoder 11, the CODEC 12 and the video encoder 27 to 
communicate an uncompressed real-time video stream. The CODEC 12 is connected 

20 to video bus 41 which allows the CODEC to output in real-time video fields of two 
uncompressed video streams to the input ports 13 and 14 of the video stream input 
buffers 15 and 16 of the graphics accelerator chip 36. In the preferred embodiment, a 
single bus TDM NX (with lime division multiplexing to support multiple streams of 
video) is used, The input ports 13 and 14, and the video stream input buffers 15 and 

25 16 are controlled by a video input buffer controller 19, The goal of the input ports 13 
and 14 is to select memory locations in each video stream input buffers 15 and 16 
according to the video input buffer controller 1 9. These memory locations will recsive 
the video streams. In the preferred embodiment, the graphics chip 36 is preferably a 
Matrox G400. 
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The CODEC 12 is controlled by the source controller 29, In the preferred 
embodiment, the CODEC 12 is a C-Cube DV25/MPEG2. The source controller 29 
has access to a video data storage 31. The source controller 29 also controls the 
video input buffer controller 19. An input buffer controller 1 8 controls the graphic Input 

5 buffer 17 which is connected to the 3D rendering engine. The 3D rendering engine 
receives data streams from the video stream input buffers 15 and IB. 

Although it will be appreciated that various architectures for video editing 
software are possible, there is illustrated in Figure 1 a video editing controller 32 
which represents the video editing user interface and controller processing 

10 associated with the application level. The video editing controller 32 may comprise, 
for exampie, the Adobe Premiere™ software package. For each specific video effect 
made available according to the preferred embodiment, a video effect filter module 
20 is provided. An example of the video effect filter 20 is fade effect, 3D perspective 
effect, organic wipe effect etc. The video effect control module 30 commands the 

1 5 source controller 29 to retrieve specific video data files from the video data storage 
31 . The video effect control module 30 also commands the input buffer controiler 18 
and the output buffer controller 33. The output buffer controller 33 can generate an 
address signal which specifies a current field address. This current field address is 
sent to the output port 26, which will retrieve the corresponding field from the output 

20 buffer 25. The corresponding field can be then transmitted to the video encoder 27 
and then to the display 28, In the preferred embodiment, the output buffer 25 has a 
large number of fields, the number of field is greater than 6, 

The video effect control module 30 provides keyframes to the desired one 
of the video effect filters 20 r 20', 20" etc.. In response, the video effect filter 20 sends 

25 commands to the graphics engine command interface 21 of the graphics chip 36 to 
implement the desired video processing within the graphics chip 36. The video effect 
control module 30 also sends commands to the graphics engine command interface 
21. The keyframe data describes the functionality of the effects and the graphics 
engine command interface 21 interprets the keyframe data to determine what specific 

30 graphics engine command is required, In the case of a video processing task 
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requiring the capabilities of the 3D rendering engine 24, the graphics engine 
command interface 21 specifies the triangle and triangle meshes oh which to map a 
video field with a resulting 3D perspective correct or non-perspective correct effect. 
Such an Object Is stored in memory 22 by data signal 42 and defined by the 

5 parameters for the vertices of the triangle or triangle meshes on which the video is to 
be mapped. Using the command data signal 45, the graphics engine command 
interface 21 is instructed to invoke either the 3D rendering engine 24 or the 2D 
graphics engine 23 to execute the desired video effect function and provide a result 
f ieid for output buffer 25, 

10 In the case of the 3D rendering engine 24, the graphics engine command 

interface 21 provides a specific command to the 3D engine 24 to map a selected one 
of the fields taken from one of the buffers 15, 16 and 17, thus obtaining a 
transformed field. 

For the sake of the description, four video effects are herein disclosed. These 
15 effects are the fade effect, the 3D perspective effect, the organic wipe effect and the 
page curl effect. 

The Fade Effect 

The fade effect is probably the most simple graphics effect that can be 
20 performed. It consists in performing a transition between two video sources. In order 
to complete this video effect, two steps are needed. During the first step, the 
background source is copied (Blit) into the destination buffer. During the second step, 
a texture mapping involving the other video source and the destination buffer is 
performed. The texture mapping {TMAP) is performed with a blend factor chosen by 
25 the user. 

In the case of the preferred embodiment, the video effect is implemented 
within the video FX filter 20. According to fig 2, and in the first step 51 , the user 
chooses using the video editing controller 32 parameters that are going to be used 
for the effect. These parameters comprise the fade threshold control being a blend 
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factor. These parameters will be sent to the graphics engine 36 via the graphics 
engine command interface 21 . 

In the second step 52, the user selects the video sources to be used in the 
effect using the video effect control module 30. The video effect control module 30 

5 sends the information to the source controller 29, The video input buffer controller 19 
then sends addresses to the input ports 13 and 14. These addresses will correspond 
to the location where the video frames will be stored inside the video stream input 
buffer. The two video sources are either real-time video stream sources or they are 
provided by the video data storage 31. The codec 12 insures that the video streams 

1 0 are real-time video streams. These two video streams go into the video stream input 
buffers 15 and 16 via the input port 13 and 14. One of these video streams is read by 
the 2D graphics engine 23 according to the first step of the video effect. 

In the third step 53, the video effect control module 30 sends command to the 
graphics engine command interface 21 to carry out a Blit, using the 2D engine, from 

15 one selected present video input buffer (15 or 16) into a destination buffer 25 of the 
graphics engine 36. 

In the fourth step 54, the video effect control module sends a command to the 
graphics engine command interface 21, this command relates to a texture mapping 
operation involving the other video source and the destination buffer 25 of the 

20 graphics engine 36. The texture mapping is handled by the 3D rendering engine 24. 

In the fifth step 55, a feedback command is sent by the graphics engine 
command interface 21 to the video effect control module 30. This feedback is 
performed using an interruption. A service routine is called and a system event is 
signalled when the interruption is generated, This feedback allows the video effect 

25 control module 30 to monitor processes. 

The 3D perspective Effect 

The 30 perspective effect is more complicated than the fade effect. In one 
embodiment, this video effect is performed using four processing operations. The first 
30 operation consists in performing a copy (Blit) of one of the two video sources referred 
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as the background source into the destination buffer. This action is similar to the first 
step of the fade effect described above. 

The second operation in the 3D perspective effect is a texture mapping of the second 
video source with soft edges and transparency in a scratch buffer. 
5 The third operation in the 3D perspective effect involves a Gouraud shading of the 
borders in the scratch buffer. 

The fourth operation in the 3D perspective effect involves the generation of shadow 
using alpha of the modified source contained in the scratch buffer, Then the second 
part of this operation involves the rendering of the perspective using the scratch 
10 buffer data, 

In the case of the preferred embodiment, the video effect is implemented 
within the video FX filter 20. According to fig 3, and in the first step 60, the user 
chooses, using the video editing controller 32, parameters that are going to be used 
for the effect. These parameters comprise the transparency control, soft edges 

15 characteristics, Gouraud parameters, the 3D world transformation matrix, the drop 
shadow parameters (drop shadow color, drop shadow position). 

In the second step 61 , the user selects the video sources to be used in the 
effect using the video effect control module 30. The video effect control module 30 
sends the information to the source controller 29. The two video sources are either 

20 reai-time video stream sources or they are provided by the video data storage 31 , 
The codec 12 feeds real-time video streams. These two video streams go into the 
video stream input buffers 1 5 and 1 6 via the input port 13 and 1 4. 

in the third step 62, the video effect control module 30 sends command to the 
graphics engine command interface 21 to carry out a Blit, using the 2D graphics 

25 engine 23, from one selected present video input buffer (15 or 16) into a destination 
buffer 25 of the graphics engine 36. 

In the fourth step 63, the video effect control module 30 sends vertices to the 
graphics engine command interface 21. These vertices will be sent to the 3D 
rendering engine 24 via the object specification memory 22. These vertices are used 

30 at this step to perform a texture mapping of one selected video source, This texture 
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mapping is done with soft edges and transparency according to the parameters 
chosen by the user via the video editing controller 32. This texture mapping is 
performed by the 3D rendering engine 24. The result is stored into a scratch buffer, 
located within the graphics engine 36. 

In the fifth step 64 5 the graphics chip applies Qouraud shading to the scratch 
buffer. This Gouraud shading is performed by the 3D rendering engine 23 according 
to parameters received by the graphics engine command Interface 21. 

In the sixth step S5, generation of shadow using the alpha of the scratch buffer 
is performed. This is performed according to informations received by the graphics 
engine command interface 21 and transmitted to the 3D graphics engine 24 which 
will perform the task. 

In the seventh step 66, the rendering of the perspective is done using the 
scratch buffer and the destination buffer 25. This is performed using the 3D rendering 
engine 24 and according to commands issued by the graphics engine command 
interface 21 . 

In the eighth step 67, a feedback command, similar to the feedback command 
described in the fade effect, is sent by the graphics engine command interface 21 to 
the video effect control module 30. This feedback allows the video effect control 
module 30 to monitor processes, 

The organic Wipe Effect 

The organic wipe effect is performed, in one embodiment, using three different 
operations. The first operation consists of copying the background source into the 
destination buffer. The second operation consists of passing a defined grey scale 
pattern into a palette expansion unit. The third operation consists in doing a texture 
mapping between two video sources and modulating this texture mapping using the 
palette expanded grey scale pattern image. 

In the case of the preferred embodiment, the video effect is implemented 
within the video FX filter 20. According to fig 4, and in the first step 70, the user 
chooses, using the video editing controller 32, parameters that are going to be used 
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for the effect. These parameters comprise soft edges characteristics, a biend factor 
for the texture mapping, and a defined grey scale shape. 

In the second step 71. the user selects the video sources to be used in the 
effect using the video effect control module 30. The video effect control module 30 
5 sends the information to the source controller 29. The two video sources are either 
real-time video stream sources or they are provided by the video data storage 31 > 
The codec 12 insures that the video streams are real-time video streams, These two 
video streams go into the video stream input buffers 15 and 16 via the input port 13 
and 14. 

10 In the third step 72, the video effect control module 30 sends command to the 

graphics engine command interface 21 to carry out a Blit using the 2D graphics 

engine 23 from one selected present video input buffer (15 or 16) into a destination 

buffer 25 of the graphics engine 36. 

In the fourth step 73, the grey scale pattern which is stored inside the graphics 
15 engine 36 is partly sent according to a softness threshold, to another location inside 

the graphics engine 36. The graphics engine command interface 21 sends this order 

to the 3D rendering engine 24 according to the video effect control module 30, 

in the fifth step 74, the other video source located in either the video stream 

input buffer 15 or 1 6 is mapped with the data contained in the destination buffer 25 of 
20 the graphics engine 36 using the alpha expanded grey scale pattern to control the 

alpha blending or keying ratio. This task is completed by the 3D rendering engine 24 

upon request of the graphics engine command interface 21 , 

In the sixth step 75, a feedback command; similar to the feedback command 

described in the fade effect, is sent by the graphics engine command interface 21 to 
25 the video effect control module 30. This feedback allows the video effect control 

module 30 to monitor processes- 

The page curl Effect 

To achieve a page curl effect, a number of video and graphics processing 
30 steps are required before the final video field can be output to buffer 25. The page 
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our! effect is, as the previous effects described above, on© example of an unlimited 
variety of effects that can be achieved with this invention. Mote precisely, to achieve 
a page cur!, the video effect filter 20 will determine, based on the keyframe data, the 
exact object data far the particular state of the page curl and output this to the object 
5 specification memory 22. The object specification memory contains as series of 2D 
and 3D graphics commands with necessary parameters to construct the desired 
effect. 

The page curl surface is broken up into a triangle mesh. The triangle mesh 
provides a means of texture mapping the video input source texture buffer onto the 

10 curved surface. This triangle mesh is broken up into a series of perspective correct 
triangle texture mapping commands to the 3D graphics engine 24, To improve the 
appearance of the page curl, the graphics hardware may be commanded to create 
mip maps of the video input surface 1 and 2. These mip map surfaces may be used 
with trilinear or anisotropic filtering on each video texture mapped triangle by 3D 

15 rendering engine 24, The rendering engina renders the texture mapped triangles into 
output buffer 25. In addition, Gouraud or specuiar lighting may be applied to achieve 
the effect of a specular highlight. Anti-aliasing may be applied to the edges of the 
page curl to remove jagged edges, Since the curled page reveals an underlying 
image (even if it is simply a background blank), it is preferred to blend the image of 

20 the curled paga with a second field for the underlying image. 

In the case that graphics titles are to be overlaid during the video editing, 
the video effect control module 30 takes the selected graphics from a graphics 
overlay memory 34 and outputs the field images, in RGB or other desired format to 
the graphics input buffer 17 via the input buffer controller 18 and the video effect filter 

25 20 commands via the graphics engine command interface 21 either the 3D rendering 
engine or the 2D graphics engine to overlay or blend or render the desired image 
using the graphics field. 

it is important to notice that data coming from the graphic input buffer 17 are 
handled like data coming from the video stream input buffers 15 and 18, meaning 
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that it is possible to achieve video effects with video frames coming from the graphic 
input buffer 17. 

The graphics engine command interface 21 provides feedback that a 
specific graphics engine command has been successfully executed using a return 

5 command path 43. In the preferred embodiment, this feedback command is issued 
when a video field is entirely rendered. For instance, this can be done after two video 
effects If two video effects are applied to a single field. In the effects described above 
(fade effect, 3D perspective effect and organic wipe effect), and only for the purpose 
of the description, each field is handled by only one effect, The graphics engine 

10 command interface 21 processes instructions in a stack. Data signal 43 is used by 
the video effect control module 30 to confirm that the processing is being carried out 
in real-time, this is done by counting free fields in the output buffer 25. If the video 
effect control module 30 detects that the graphics chip 36 has not been able to 
complete quickly enough the requested video image processing, and that the output 

15 buffer 25 may be depleted, the video effect control module 30 may change, in one 
embodiment, the nature of the keyframe data either to specify that simpler video 
effects are to be performed or that a given frame or number of frames should be 
skipped in order to ensure that the remainder of the video editing takes place in real- 
time without the video output buffer 25 being depleted. In another embodiment, the 

20 video effect control module 30 may also inform the video editing controller 32 that the 
graphics chip 36 has not been able to complete quickly enough the requested video 
image processing, and that the output buffer 25 may be depleted, According to user 
preferences, the video editing controller 32 may inform the user with a pop up 
message, 

25 
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What is claimed is; 

1 . A video editing apparatus for performing video editing in realtime of at least 
two video streams derived from a codec able to retrieve two video sources from a 
data storage device and output two uncompressed video data streams, the 
apparatus comprising: 

a video data storage device; 

a graphics processor having at least two video inputs and a video output; 
a video decoder having a video signal input and an uncompressed digital 
video output; 

a video encoder having an uncompressed video data stream input and a 
display signal output; 

a first video bus transferring data between said video output of said 
graphics processor and said video encoder when said apparatus is operating in a 
realtime video editing mode; 

a second video bus transferring data between said codec and said at least 
two video inputs of said graphics processor when said apparatus is operating in a 
realtime video editing mode; 

said video decoder using one of said first and said second video buses to 
transfer data to said video encoder in a non-editing playback mode, and said video 
decoder using one of said first and said second video buses to transfer data to said 
codec in a video capture mode, 

2. The apparatus as claimed in claim 1 , wherein said video decoder transfers 
data to said codec and to said video encoder using said first video bus. 

3. The apparatus as claimed in claim 2, wherein data is transferred from said 
video output of said graphics processor to said codec for compression and storage in 
said video data storage device. 
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4. The apparatus as claimed in claim 3, wherein said graphics processor has 
an input buffer for storing a sequence of fields of said at least two video inputs and 
an output buffer for storing a sequence of fields of said graphics processor video 
output. 

5. The apparatus as claimed in claim 4, wherein said input buffer also stores 
input graphic image fields. 

6. The apparatus as claimed in claim 1 , wherein said graphics processor has 
an input buffer for storing a sequence of fields of said at least two video inputs and 
an output buffer for storing a sequence of fields of said graphics processor video 
output. 

7. The apparatus as claimed in claim 6, wherein said input buffer also stores 
input graphic image fields. 

8. The apparatus as claimed in claim 1, wherein said second video bus is a 
single bus communicating data multiplexed on said bus to all of said at least two 
video input. 

9. The apparatus as claimed in claim 7, further comprising an input for 
compressed digital video input from external device, and a decompression device, 
one of said at least two video inputs comprising decompressed data from said 
compressed digital video input. 

1 0. The apparatus as claimed in claim 9, wherein said compressed digital video 
input comprises one of an IEEE 1394 interface and an SDTI interface. 
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ABSTRACT 

An architecture which allows real-time video editing using a 2D/3D graphics engine. 
This architecture comprises input and output buffers. It receives video streams from 
either compressed sources of data or non compressed sources of data. This 
architecture allows a flexible upgrade of the video effects using software plug Ins. 
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Declaration and Power of Attorney for Patent Application 

Declaration et Pouvoir pour Demande de Brevet 
French Language Declaration 



En tanr qu'inventeur ci-apres design^ je declare par !a presents 
que: 

Mon doroicilti, mon adresse postale et ma nationality sunt tels 
que figurant ci-dessons a e6te* de mon nom. 

h crois £tre le premier inveuteur original et unique (si un seul 
nom est insnfiavinc ci-dessous), ou i'un des premiers co* 
inventeuw originanx (si plusieuTs noms sont mentioning ci- 
dessous) de 1'objet rsvcndique* pour iequei one demande de 
brevet a etA d^pos^e concernant Invention intitule 



As a below named inventor, I hereby declare that: 

My residency post office address and citizenship are as stased 
next to my name. 

I believe I am the original, first and sole inventor (if only one 
name is listed below) or an original, first and joint inventor (if 
plural names are listed below) of the subject matter which is 
claimed and for which a patent is sought on the invention 
entitled 



"REAL-TIME ViPEQ EDITING ARCHITECTURE" 



et dont le memoke descriptif est ci-jakt a moins que la case 
suivante n'ait 6t£ cochee" 

□ a cbS d&poses le _ , , sous le num&G 

de demande de$ Etats-Unis ou le nuroero d* demande 

Internationale PCT , . 

modifies le .. ^ (le ess echtant). 

Je declare par la priseate avoir revise et compris ie contenu du 
mimoire descriptif ci-dessus menriormE, ineiuant leg 
revindications, telles que nsodifiecs par toute modification ci- 
dcssxis mentionnes. 



the specification of which is attached hereto unless the 
following box is checked: 

□ was filed on Sept. 1 , 2000 as United States 
Application Number of PCT International Application 

Number Q9/unkrtown _ and was amended 

an (if applicable). 

I hereby state that I have reviewed and understand the concents 
of the above identified specification, including the claims, as 
amended by any amendment referred to above, 



Jc recoimais devoir divulguer toute information pertinente a la 
bievetabilite, t*i que defini dans le Titre 37, §1.56 du Code 
federal des r&gkrnentations. 

Je irevendiqut par la prisente la priority stranger e, en vertu du 
Titre 35, §ll$>(a)-(d) ou §365(b) du Code des Etats-Unis, sur 
toute demande etrang&re. de brevet ou csrtific&t d'iaventeur ou ? 
en vertu du Titre 35, §3 55(a) du mSme Code, sur toute demande 
internationale PCT d£sigaam au moins un pays autre que les 
Etats-Unis et figurant ci-dessous ct„ en cochant la casej'ai aiissi 
indique ci-dessous toute demande etrang&re de brevet, tout 
certificat d'inventeur ou touts demande Internationale PCT 



I acknowledge the duty to disclose information which is 
materia! to patentability as defined in Title 37, Code of Federsi 
Regulations., §1,56. 

I hereby claim foreign priority under Title 35, United States 
Code, §119(a)-(d) or §365 (b) of any foreign application^) for 
patent or inventor's certificate, Or § 365(a) of any PCT 
International application which designated at least one country 
o&er than the United States, listed below, and have also 
identified below, fey checking the box, any foreign application 
for patent or inventor's certificate, or PCT international 
application having a filing date before that of the application 
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French Language Declaration 



ayant une date de depot precedant celle de la demande a propos 
de laquelle une priorite est revendiquee. 

Prior foreign applications) 
Qemande(s) de brevet ariterie\ire(s) 



on which priority is claimed 



Priority Not Claimed 
Droit de priorite non revendique 



(Number) 
(Numero) 



(Country) 
(Pays) 



(Day/MDnth/Yeax Filed) 
(Jouf/Mois/Annee ds dipdt) 



(Number) 
(Num6ro) 



(Country) 
(Pays) 



(Day/Month/Year Filed) 
(Jour/Mois/Annee ck depot) 



Je revendique par la presente tout b6neTice, en vertu du Titre 
35, fill9(e) du Code des fitats-Unis, de toute demande de brevet 
provisoire effective aux Etats-Ums ei figurant ci-dessous. 



I hereby claim the benefit under Title 35, United States Code, 
§ 119(a) of any United States provisional applications) listed 
beiow. 



(Application No./ N° de demande) 



(Filing Date/ Date de dep6t) 



(Application No J N° de demande) 



(Filing Date/ Date de depdt) 



Je revendique par la presents ton: benefice en vertu du Titre 
35, §120 du Cods des 6tats-Unis 3 de touts demande de brevet 
effectual atix fetels-Unia, ou en vertu du Titre 35, 5365(c) du 
meme Cede, de toute demande intemationale PCT ddsignEuat 
les £tats-Unis et figurant ci-dessous fit, dana la mesure ou 
I'objet de chacune des revindications de cette demande de 
brevet ri«t pas divulgu£ dans la demande anterieure 
^mericaine cu iflternationalc FCT 3 en vertu des dispositions du 
premier paragraphs du Titre 35 , §112 du Code des fitats-Unis, 
je reconnais devoir divulguer toute inforcnatiari pertinente a la 
brEvctabilite, tel que defuti dana Is Titre 37, §1.56 du Code 
f£d6ral des regimentations, dont j'ai pu disposer entrs la date 
de dcp6t de la demands anterieure et la date de depot de la 
demande nationals ou Internationale PCT dc la presents 
demande: 



I hereby claim the benefit under Title 35, United States Code, 
§120 of any United States applications), or §365{c) of any 
PCT International application designating the United States, 
listed below and, insofar as the subject matter of each of the 
claims of tins application is aoi disclosed in the prior United 
States or PCT International application in the manner provided 
by the first paragraph of Titled United States Code, §1 12, 1 
acknowledge the duty to disclose information which is material 
to patentability as defined in Title 37, Code of Federal 
Regulations, §1.56 ^hich became available- between the filing 
date of the prior application and foe national or PCT 
International tiling date of this application. 



(Application No.) 
(N* de demande) 



(Filtag Date) 
(Date de depdt) 



(Status) (patented, pending, abandoned) 
(Statut) (brevet^ en cours d'examen, abandon^) 



(Application No.) 
(N D de demands) 



(Filing Date) 
(Date de depSt) 



(Status) (patented, pending, abandoned) 
(Statut) (brevets, en cours d'fi^ameri, abandon^) 
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Jd declare que toute tea declarations faitas dajis la presents sont 
a ma connaissance, veridiques fit one toutes les declarations 
faices a partfr de renseignements ou de suppositions sont tenues 
pour yeridiqucs 7 ct de pbs f qtie toutes ees declarations out etc 
faites en sachant que touts fausse d&lar ation volontaire ou son 
equivalent est passible d'mis amende ou d'une peine 
d'emparisomiementj ou des deux, en vertu de U Section 1001 du 
Titre 18 du Code des fitats-Unis, ct que de telles declarations 
volontaksment fausscs risquent de compromettre la validity de 
la demandc de brevet ou du brevet ASliYrf k partir de cdle-ci. 

POUVOIR; En tant qu'mventenr d£sign£ s Je nomine par la 
presents l'(les) avocat(s) ettou agent(s) Indus sous le numero 
de client ofBciel suivant, avec plein pouvoir de revocation et 
de substitution, charges de poursuivie cette demande et de 
traiter toute affaire s f y rapportant avee l'Office des brevets et 
des marques; (menttonmr le nam et U numzro 
d'enregistrement). 



I hereby declare that all statements made herein of my own 
knowledge arc true and that all statements made on information 
and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false 
statements and the Like so made are punishable by fine or 
irnprisonrnenx, or both, uridsr Section 1001 of Title 13 of the 
United States Code and that such willful false statements may 
jeopardise the validity of the application or any patent issued 
thereon. 



PQWEft OF ATTORKBY: As a named inventor, I hereby 
appoint the agents and/or attorneys included in the following 
Customer Number, with M power of substitution, 
association, and revocation, to prosecute this application aad 
to transact all business in the Patent and Trademark Office 
connected therewith; (list name and registration number) 



Please send all correspondence and direct all telephone calls to: / Veuiltez adiesscr touts correspondance et tout appel tekphonique a: 

Hill 

020988 

mm M0 TttfflAS OFFICE 



Full name of sclc or fnsi inventor (Norn complct dc Vuniqae ou premier iirvratar) 
Lome TROTTiER 


Cmzetistop (Nationality 

Canadian 


Date (dd/him/yyyy) (jj/mWaaaa) j 


Residence and Post Office address. (Domicile et adresse pos^ale) 

52 Lakeshore Rd, ? Beaconsfield, Quebec, Canada H9W 4H3 


Inventory signature (signature dc l'inventeur) 


full name t>f second inventor (Mom complct du second co-inventeur) 

Michel ST-PIERRE 


Citizenship (Nationality 

Canadian 


Date (ddAnm/yyyy) (jj/mrn/fc&aa) 


Residence and Post QfFiet iddtess (Domicile cc adrcssc pastale) 

208 Robitaille, Ste-Darothee, Laval, Quebec, Canada H7X 3N1 


Second Inventor's signature (signature du second inveawvr) 


Fwll same of third co-inventor (Norn tomplet du troisiemc co-invtintstif) 

Andre LAFRAMBOISE 


Citizenship (Naiionalite) 

Canadian 


Date (dd/miB/yyyy) (ii/mni/aaaa) 


Residence and Post Office address (Domicile ct adresse postale) 

£3 Pasca!, Notro Dame ds L'lle Perron Quebec, Canada J7V 8Z9 


Third Inventor's signature (signature du troisi^me invaiteur) 


Full name of fourth winventof (Nom complct du quatrifcmfe ecMfivsfiteur) 

Jean LAPIERRE 


Citizenship (Nationalise) 

Canadian 


Bate (ddTmm/yyyy) (jj/mrn/aaaa) 


Residence and Foss Oftlc? address (Domicile et adrcssc pgslilt) 

18644 Budge, Pierrefonds, Quebec, Canada H9K 1 K8 


Fourth fcwemaf's signature (Signature du quatriferne inventeur] 
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